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ABSTRACT 

When one learns complex material, the impor 
appears to be the ability to understand the material. Once 
understanding occurs, learning and remembering follow autom 
The conventional psychological literature says little about 
processes involved in the learning of complex m aterial--jaat 
takes weeks, months, and even years to be learned. Yet, mos 
learning is of this form. This paper examines some of the i 
are involved in this type of learning, issues such as the n 
understanding, the types of hypotheses that subjects bring 
the learning process, and the types of processes that need 
studied in order to understand the psychology of learning. 
(Author) 
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Cognitive Organization and Learning^ 

•f 

■ Dona la A, Norman 
University of California, San Dieqo 
La Joila, California 92037, USA 



Memory and Learning 

Just what happens when a compl ex,,..sub ject matter is learned? 
Despite progress in unravelling the structures 
- of sensory and short-term memory and despite tantalizing starts 
towards the representation of semantic material, we still have 
little Linaerstanding of just what happens in learning. 

One thing concerns me about our understanding of the memory 
process, When I learn new material — such as the content of the papers 
presenteo at this symposium — almost none of this learning reguires 
the kind of attentive rehearsal processes so well studied in the 
psychological literature on snort- and long-term memory, I listen, 
I understand. And that is that. Mo rehearsal. No formal attempt 
to categorize or organize. Simply understanding. If I fail to 
understana, then I will also fail to remember, I have been examininq 
the learning of complex material in an attempt to determine the 
psychological processes that are acting to ensure proper retention^ 
Cjt^omplex materials are those that require days or weeks to acquire,) 
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Again, I find that the traditional acquisition processes which I have 
heretofore been studying are of little itiportance • In this paper, I 
make a. step towaras a description of the mechanisms that do operate 
in tnese situations. 

One thing seems to be clears in order to learn material 
for later use, it helps to have that material organized in an aopro- 
priate manner. If this is done, or if the process of organizing the 
material is part of the learning task, then the permanent acquisition 
of that material appears to be done reasonably effortlessly. Other- 
wise, effort is needed to ensure its permanent retention. The 
psychological literature shows many examples of the efficient learning 
that can occur when organizational processes accompany exposure to 
material — even when no formal attempt is made to retain the material. 
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Two Types of Rehearsal 

In the earlier theories of the way that information was trans- 
ferred from short-term to long-terra memory, it was thought that 
rehearsal played an important role (for example, the model of 
rtaugh & Norman, 1 y6b) . Today, it appears that the 
argument is not so simple. Rehearsal of an item appears to help 
strengthen its memory representation, but in ways that n^eed not be 
useful for later recall. Craik 8. Watkins (in press), Bjork (in press), 
and ^voodwara, Bjork & Jongeward (in press) have shown how repeated rehear- 
sal of some, material need not leao tc an increase in the ability of a 
subject to recall that material • More important, 

they have found iz necessary to distinguish between 

two types of rehearsal processes: one that seems primarily effective 
in maintaining the item within short-term memory, the other that 

seems designed to aid in its later re tr ievabi li ty . Let me call these two 
forms rehearsal for maintenanc e and for accessibi li ty . 

The paraaigmatic experiment looks like this (after Woodward e t a 1 . ) : A 
subject is shown "a list of words, some of which he is aoing to be asked 
to remember for a future test, others of which will not be tested^ 
Dut he is not tola which is the case until some interval of time has 
passed from that item^s presentation (nothing else is presented in 
that interval, howe.ver). Thus, during that interval, the subject 
can either choose to attempt to learn the item presented or can 
instead simply choose to maintain it in SIM, waiting for the appro- 
priate signal to decide what to do next. 

er|c 
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Woodward et al • showed that the interval of time that passed between 
the initial presentation and the siqnal did not affect the- ability 
of the subject to recall the material at a later test, whereas the 
length of the interval that occurred after the signal and before the 
presentation of the next item did make a difference. This fact alone 
would seem to suogest that during the initial period, subjects main- 
tainea the item in STM without transferring it to LTM. This is not 
compietely correct, however, because when the subjects were tested 
on a recognition test, the earlier interval did make a difference. 

Thus, we appear to have a rehearsal process that strengthens the 
memory trace as measured by a recognition measure, but that has no 
effect on memory as measured by a recall measure. 
Any theory that postulates a role for rehearsal as a method for 
strengthening memory representation is partly correct, but fails to 
recognize that suDjects can perform different kinds of processes 
during rehearsal. Moreover, it fails to take into account the 
distinctions oetween memory structures that are testea by tests that 
use recall techniques and by tests that use recognition. 

fczndel Tulving (see Tulving & Madigan, 1970) has long argued 
that it is important to distinguish between 
the strength of an item in memory and its accessibility 
That is, information could very well be present in a memory, but 
simply not easily accessible, especially by simple recall tests. 
Tne evidence collected by Woodward et__ai. supports this view by 
demonstrating that a subject^s renearsal activities seem able to 
affect memory strength independently of memory accessibility. 

ERLC 
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Craik (1973) and Craik A Lockhart (1972) have argued that it is 
important to consider the depth of processing that memory information 
undergoes* To a> large extent, they claim, the depth of processing 
determines the later retr ievabi 1 ity of inf ormat ion t 

there is:a strong correlation between how deeply an item is processed 
and the normal interpretation of the memory stage at which an item 
is represented. Thus, about the least meaningful amount of pro- 
essing that an item can undergo is to be recognized, and this stage 
of pattern recognition is usually considered to be synonymous 
with short-term memory storage. Acoustic features are 
abstracted at this levels When an item is processed in some way 
that reflects, its semantic characteristics, it also tends to be 
retained for longer periods of time. This araument was so compell- 
ing for Craik and Lockhart that they suggested a new interpretation 
of the literature on short-term and long-term memory. 
Perhaps, instead of several discrete types of memory, 
there is a single, unitary system, one in which items presented to 
it receive differing levejl^s of processing and thereby give the 
appearance of different memory stages. I disagree with this part 
of their argument. Nonetheless, it isn-'t necessary to accept 
their entire argument to realize the importance of their analysis 
of the role that depth of processing plays. Consider this implication, 
however « the more deeply. an item is processed, the more 
likely it is that it will be retained in memory. 
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The Learning of Complex Material 
1 . 

Most, contemporary researchjon memory has concentrated on the 
study of relatively simple information. When we come to the study 
of how a person learns a complex body of material, we find almost 
nothina. Yet, in our normal adult lives, it is the learning 
of complex material that occupies most of our time. We must often 
study a topic for days, weeks, or even years before claiminq to 
have mastered it. Some people are unable to learn some topics, 
even though others who appear equally able do so readily. 

I would like to know what goes on within the head of the learner. 
To do so, .it is clear that I must study topic s • rela ted to the orqa-- 
nization of material and to depth of processing. One interesting 
point about; the learning of complex material is that often the 
problem is not really one of memory. Rather, the material is 
either unaerstood (and therefore learned) or it is not. Often, tne 
1. earner will struggle with a concept until he comes to understand 
iti at that point he claims to have learned it. 

lAihy does memory acquisition appear to play such a major role" in 
theories of psychology and yet a relatively minor role in much 
actual learning of complex topics? What is meant by "understand- 
ing"? These would appear to be the important questions that must 
be faced if ever we are to claim to understand human cognitive 
processes. 

Note .that it is possible to reformulate the learning of the 
traaitional material studied in memory research, 
When subjects are able to aevise encooing strategies for the 
material, then they find that retention becomes easy, almost auto- 
matic. Many of the mnemonic systems in use by .those who practice 
tne art of memory make use of the fact that given a suitable encod- 
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log, no real effort need oe exerted to remember material. In the 

I 

experimental laooratory, numerous investigators have shown that the 
discovery of a sensible encoding strategy makes memory for the items 
very easy. A good example of this is Bower^s demonstration 
of the ease with which suojects could learn words once they 
were able to put them into sentences (see Bower, .1970, for a 
review on mnemonics). The classic study is probably ^ 
the one that demonstrated that with suitable mnemonics, 
as many as 500 paired associates could be learned ^ 

essentially completely with a single presentation of each pair (actual 
recall was 496 words correct; Wallace, Turner & Perkins, 1957). 
In these studies, as in all uses of 

mnemonic devices, the trick is to discover the appropriate mnemonic « 
once discoveredf the learner can simply pass on to the next 
item with little or no further processing. 

I will illustrate the problem of learning by considering 
two particular problems. First, I consider the 
teaching of a computer programming language. 

I choose this topic only because it is convenient^ it seems to be 

at about the right level of difficulty to guide our studies. 

It is very simple. Someone who knows computer progrjamming 

but who has never seen this particular language can Ijsually 

leam it simply Dy reading the list of commands, a process that may 

take less than five minutes. Yet, students who have no background 

in programming sometimes take weeks to learn it. Thus, the topic 

is well defineld, it is simple, yet it is complex enough to be 
a good vehicle for study. 

Second, I consider a problem of rule induction from the tradi- 
tional literature on problem solving: Luchins^ (1942) water Jug 
'^^'^blem. This provides a typical paradigm for learning, even 
it is not normally viewed in that light. 
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iiUiJfil* The programming language called FLOW was developed by 
Professor Jeffrey Haskin at the University of California, San Diego 
for use in teaching computer programming to students in the visual 
arts, students who both had little knowledge of science and mathe-- 
matics and who also disliked these subjects. FLOW is unique in 
several ways. First, it has been designed to simplify the process 
of entering information into the computer. At any point in the 
program, only the typewriter keys which lead to legal commands 
are operative. When a key which woi^ld lead to an illegal 
character is depressed, it has no effect. In addition, by a system* 
called "typing amplification,^' whenever the user has typed a 
sufficient number of characters that the computer can unambiguously 
interpret which command is meant, the entire command appears on the 
screen without waiting for the student, to finish. Thus, by these 
two features^ the most common problems for the beginner are eli^ 
minateds typing errors and difficulty with the keyboard. In addi- 
tion, we have modified the system to add several other useful 
features for our studies.^ 

The command set of FLOW is illustrated in Table 1. In this 

Insert Table 1 about here 

table, the part of the command that the student must type is underlined. 
The language is essentially self-explanatory, except perhaps 
for the commands that refer to -"IT.-" IT is the name of a pointer 
that refers to. a single letter in a string of text (the text is 
always the ^'ThXT IS ... " .statement that was encountered most 
recently in the stream of processing). When first invoked^ the 
IT' pointer refers to the first letter of the text. Each time the 
ERylC'mmand GHT IT is used, the pointer moves one letter to the right 



Table 1 
The FLOW Language 

The student only has to type the underlined letters. (Some commands fall 
into more than one category, and so they are repeated.) 



CONTROL STATEMENTS 

If it is ^EV go to 255 

If _counter is 42 go to 240 

Go to 1£ 

jStop 

COUNTER CONTROL 



PRINT STATEMENTS 

£rint ^ THAT IS CORRECT: ' 
_Print _return 
£rint _counter 
£rint it 

SYSTEM COMM.WDS 



Make counter zero 
A^dd one to counter 
D^ecrease counter by one 

£ounter is 7_ go to 290 
£rint ^counter 

TEXT MANIPULATION 

Text is J THE HOUSE IS RED. ' 
Get it 



If it is 'E' go to 235 
Print it 



Run 

Walk 

I^ist 

New 

Help 

(Escape) 

Backspace 



Line numbers 



iu 



along the text string* (A text string is assumed to contain 

an indefinite number of blanks at its riaht, so that 

when repeated use of the GHT IT command runs out of letters on the 

text string, it wil: sn continually point at a space*) 

For example, a program to count the number of times the 
letter "H" occurs in a sentence looks like this* 

10 Text is "THIS IS A SAMPLE SENTENCE." . 
20 Make counter zero 

30 Get it ' . . 

40 If it is ".^' go to 200 

50 If it is -^'E" go to 100 

60 Go to 30 
100 Add one to counter 
110 Go to 30 

200 Print "The number of E^s is" 
21 0 Print counter 
220 Stop 

This simple language allows many fundamental properties of pro- 
gramming to be taught while maintaining a simple structure* 
The concepts of simple conditionals can be taught, as well as simple 
text manipulation* A pointer is present* Algorithms and loops 
or iterations can be taught* Some things cannot be done, such as 
letting program statements be called by other parts of the pro- 
gram (subroutines, co-routines, recursion)* Any program that 
requires more than one pointer or more than one counter at a time 
cannot be performed. But despite these limitations, once 
the student has learned FLOW, he is in a good position to move on to 
"ny of the more advanced algebraic languages such as ALGOL, BASIC 
or FORTRAN * 3 
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Teaching FLOW 

The basic language contains a set of only 12 different commands. 
In addition, there are 5 system commands, as well as some simple 
conventions used for typing line numbers and correcting lines* 
The program Just illustrated requires the use of only 9 
different commands (including two different forms of the PRINT 
commands). In addition, the student should know at least 3 
system commands or concepts* How to LIST a program, how to RUN 
a program, how to type in statements and how to correct errors. 
Clearly, however, there is more to understanding the language than 
tnese simple lists of concepts. 
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Learning as Problem Solving 

In learning to program FLOW, the subject has to learn the 
commands by acquiring them into long-term memory^ Yet the command 
structure is perhaps the easiest part of the learning task, and 
perhaps the least essential. Simple memory acquisition thus 
plays almost no role in the learning of this process. If we 
examine what a subject must do in order to solve a typical program — 
say the program just illustrated — we see that it is more like 
problem solving than anything else: the subject needs to learn how 
to solve programming problems. 

Now we are faced with a new issues what is involved in learning 
now to solve a problem? Indeed, what is involved in simply 
solving a proolem? For one thing, to solve a problem, a subject 
must learn to put together rules and processes, not simply static 
concepts. Orie reason why our theories of memory are of such little 
use in the study of this topic is that the memory theories deal with 
static concepts and not with processes. Thus before continuing the 
discussion of FLOW, it makes sense to examine problem solving. 
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Hroblem Solving 

To solve a problem at least two separate components are 
needed. First, the basic structure of the problem and of the al- 
lowable operations must be learned. Second, the operations must be 
combined in the appropriate way for getting to the desired goal. 
The learning of a board game or a card game (chess, gin rummy, go, 
bridge, gomoku) is a good example. Usually, an adult can be taught 
the rules of a new board or card game relatively easily, often with 
a single recitation of the rules. Moreover, once having heard 
those rules, the beginning player can make intelligent movess 
ne does not simply select moves randomly from the set of legal 
moves. Thus, some basic strategies do not have to be taught. The 
formal learning of the game structure may require only a short period 
of time. The learning of appropriate strateaies that transform the 
initial strategies of a beginning player to the more , advanced ones 
of an expert is both difficult and time consumings the time is 

measured in years. There is. very little research on this type of 
learning. All that I know about the stages in this learning process 

comes from the work by Eisenstadt & Kareev (1973). Although Newell & 

Simon (1972) have treated probl em solving the most thoroughly of any 
modern investigators, they say very little about the lerirning of problem 
solving skills. 
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can perhaps get an idea of what skills are involved in problem solv- 
ing (and, therefore^ in computer programming) by examining one 
of the classic studies in the literature; Luchins^ (1942) studies 
of the water jug problem. , 
Here is a statement of a typical problem: 

You are given three jugs of waters 
one holds exactly 21 gallons, 
one holds exactly !27 gallons, 
and one holds exactly 3 gallons. 
Your task is to determine how 
you can end up with exactly 100 
gallons. 

To solve this problem, the subject needs to know (or assume) that 
water is available from an unlimited source. He must also. know what 
it means to fill and empty a container. In the original experiment 
by Luchins, this particular problem followed one that involved 
only two containers and in which the experimenter had explained 
the answer if the subject had not gotten it after 2 minutes. (The 
answer to this three jug problem was given if the subject could 
not discover it in 3 minutes.) After these two problems were pre- 
sented, the experimental series of 9 similar problems followed. 

To solve the problem, the subject must first understand the 
operations that are available, including the conditions for their 
, application. and the results that will occur. Notice that the opera- 
tions themselves are not stated as a part of the problem.^ Basic- 
ally there are three types of operations* to pour from one container 
to another; to fill a container? and to empty a container. These are 
y describee in Table 2.^ 
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Insert Table 2 here 

No single one of the operations of Table 2 will solve the prob- 
lem* to reach a solution, the basic operations must be combined in 
some way. To do this requires a me ta-ope ra ti on , a statement about 
wnat operations are permitted on the operations themselves. Finally, 
the me ta--operat ions may yield a combination of . operations that yield 
the answer. Call this sequence a strategy. In the actual experi- 
ment conducted by Luchins, after he gave his subjects this three 
jug problem, he gave them four more, where each of the five problems 
could be solved by the application of the same strategy: 

* Fill the largest jar. (Empty the other two.) 

* Pour from the largest jar to the medium jar. 

* Pour from the largest jar to the smallest jar. 

* Empty the smallest jar. 

* Pour from the largest to the smallest. 

The desired amount. is now left in the largest jar. 

The problem I am interested in is how subjects were able to 
derive that sequence. To Luchins, that was not of much interest. 
Rather, he wanted to Demonstrate the fact that once a strategy had 
been developed, the subject would follow it. Thus, after the five 
tnree jug problems^ he asked them to solve this one.s 

You are given a 23, a 49, and .a 3 gallon container. 
Your task is to get 20 gallons. 
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Table 2 

■( 

Possible Operations for the Water Jug Problem 

■ { 

Let X be the name o£ a container. Then C(x) represents the capacity of 
container x and W(x) represents the amount o£ water contained in x. 1 

Let W^(x] be the final state of W(x) and W. (x) the initial state. 

^ ' ■ \ 

Clearly, ' j 

Both C(x) and W(x) i 0 - ' | 

and WCx) 4 C(x] . ■ . 



Operation 


Initial Conditions 


Final Conditions 


Pour from A to. B, 


W . (A) > 0 

1 

W.[B) < C(B) 
IV. (A) < C(A) 


If W.(A) < C(B) - W.CB), 
W^(A) =■ 0 

W^CB) = W.(B) + W.(A) 
Otherwise, 

Wf(A) = W.(A) - [C(B) - W.(B)] 


Fill A. 


W (A) = C(A) 


Empty A. 


l\'^(A) > 0 ■ 1 W^(A) = 0 


Meta-operations for Combining Operations 


1. Any operation may follow any other operation if the proper preconditions are met. 

2. Any operation that leads to a state that was previously present is not permitted. 
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Subjects invariably follow the strategy they haa developed previous- 
ly, emptying the 49 gallon container once into the 23 gallon one, 
tnen emptying it twice into the 3 gallon one, thus getting 20 
gallons (49 - 23 3 - 3). Rarely does a subject who has experienced 
tne entire sequence of problems simply pour from the 23 gallon 
container to the 3 gallon one. 

To Lucnins, this was Lhe detrimental effect of set or 
iLiHSiSliilOa. I believe i t to 

illustrate quite a different point: the efficient use of 
strategies* I suspect that the development of a new strategy by 
application of meta-rules requires more effort than the following 
of a previously determined strategy. If this is true, then the 
suDjects were minimizing their mental effort by solving this 
new problem simply by applying a strategy that was known to be 
successful. 

The solution of a problem requires a number of different steps 
and- concept s. The problem must be understood. The various 
permissible operations must be determined, and they in turn must oe 
understood. A set of meta-operat ions must oe applied to form a 
strategy. Finally, if there is to be any learning, successful 
strategies must be recoanized ana used again, perhaps by 
adding newly developed strategies to the set of operations 
tnat are permissible* 
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Learning FLOW 

Now let us return to the examination of the computer programming 
language. To program, it is necessary that tne student acquire 
some knowledge of how commands may be combined* Before this can 
be done, the student must understand what computer languages 
ana programs are. The student must understand the problem he is to 
solve, he must know the specific commands of the language, and he 
must understand the meta-operations that characterize the art 
of programming. Finally^ he must acquire specific strategies for 
specific classes of problems* 

The difficulties of learning to program are almost completely 
divorced from the formal difficulty of ^learnfng^* or of acquisition 
into memory. The hard task is the task of understanding* once that 
is accomplished, memory follows automatically. 



Hroposi tional and Algorithmic Knowledge 

In his recent studies of learning, Greeno has considered issues 
similar to those discussed here (see Greeno, I973)* One issue 
concerns the relationship between general f actual 
JiQfitti££iCl£ (such as the statement that 

a jug can contain water) and a I gor 1 thmic 
k nowledg e (such as the strategy that solves the 

water jug problem). The distinction between the two forms is not 
very clean, and in fact it is possible to argue that algorithms are 
simply collections of factual statements: in an algorithm, the 
statements convey information about operations that can be 
performed. As Greeno himself puts it: i 
"Factually, it seems clear that the structures in 
semantic memory cannot be neatly partitioned into 
some that are algorithmic and others that are 
proposi tional in the more general, conceptual 
sense. I feel quite sure that I have both 
proposit ional and algori thmi c know ledge about 
physical density, and I am not proposing that in 
such cases we postulate two cognitive structures, 
one for the algorithm and the -other for conceptual 
understanding. However, there are also some rela- 
tively clear cases. My knowledge about integration 
by parts is almost purely algorithmic, except for 
the conceptual knowledge that I have about integrals 
generally. I can remember the algorithm (sometimes) 
and carry out the operations, but I do not have much 
understanding of why it works, and I do not predict 
O at all reliably when it will be helpful." 

ERIC 
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But even if the distinction is not clear, it is still useful. 
Consider the FLO;^ language: To be able to solve the problem 
of printing the number of b^s in a sentence» the student must 
understs.-id both conceptual and algorithmic ideas. He must know the 
ccnceptual knowledge carried by the commands (see Table 1). 
In addition, he must be aware of the ways in which these 
statements are entered into the computer, and how the program is 
actually executed. He must also have certain types of algorithmic 
knowledge, for example^ 

* How to do tests for proper conditions. 

* How to do loops, or iterations. 

* How to properly sequence instructions. 
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Stuaent Presumptions 

I have already remarked on the fact that even a naive learner 
starts with certain Dasic assumptions and predetermined strategies. 
Thus, upon learning the rules of a new game, the adult player plays 
sensibly even on his first attempt. This beginning knowledge 
may not be a virtue. One major difficulty in teaching a topic is to 
overcome stuJents^ prior concepts. When students have difficulty in 
acquiring a concept, it oftpn means they are attemptino to acquire 
the wrong one. Consider these examples? 

* The instructor in tne normal university course on FLOW 
(Processor tiaskin) stuaiously avoids 
telling the students that what they are 
doino has anything to ao with computers until long 
after they have learnea to program (the word ''program" 
is not used either). Otherwise, he says, a student 
who dislikes science may invoke the one firm conceptual 
statement of knowleage ne has aoout computers: He 
can^t understana them. This is a self-fulfilling prophecy. 
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★ students may sometimes stiuoqle with the keyboard for 
long periods of time, eviaently failinq to understand 
very simple concepts. 

* One student spent considerable time constructing the 
symool for the letter 'H)" (oh) out of a left and 
riqnt parentheses. The reasonx the computer typewriter 
(a General Electric Terminet) which was used to print 
the teaching manual for FLOW has a gap in the 0 at the 
top and bottom in order to distinguish it from a zero. 
Clearly, this attrioute of the problem was thought to be 
important oy the student even though it was of absolutely 
no interest to us. 

These examples show something of the nature of the hypotheses 
that students bring to bear on the learning task. In some sense, 
tnese prior hypotheses are at the crux of the problem. To the 
stuaent, the task is very much one of concept formation. He must 
somehow grasp the concepts that are Involved In the situatioPt No 
matter that the experimenter is on his side, trying to help. The 
subject still must hypothesize and test, hopefully managing to 
separate the irrelevant from the relevant* 



23 

These errors of students are comical at first, but they are 
serious. They indicate that the students are struggling to perform 
the appropriate task, but that they have grasped at the incorrect 
concepts. The problem is akin to that faced in the concept formation 
literature when incorrect hypotheses often cause a subject to fail 
to get the appropriate classification chosen by the experimenter 
(See Trabasso & Bower, 1968; or Lev ine , 1 971) . We could argue, in 
fact, that this is a problem in attention, with the student select- 
ing for attention in the learning situation inappropriate attributes 
of the situation. Thus, the student who is attempting to print a 
symbol by comoining two parentheses is working efficiently at the 
wrong aspect of the problem, one that in concept formation terms 
is simply called an irrelevant dimension. 

rte see that part of what is going on in the learning of complex 
tasks is akin to the processes of concept formation. Memory does 
not play much of a role in the understanding of either complex 
tasks or concepts, although it is important in allowing the 
subject to determine Just what attributes of the situation are 
relevant. Once the appropriate concept is discovered, then it must 
De remcmberea, of course, but this learning is probably more 
like the simple aU-or-none learning discussed by BJork (1968) 
for the acquisition of simple strategies than it is of the more 
laborious type of learning by repeated trials that is so often 
discussed in the literature on short- and long-term memory. 

The concepts involved here, of course, differ considerably from 
those normally studied within the concept formation literature. 
Moreover, the learning situation differs from the other in that the 
experimenter is desperately attempting to help the student acquire 




relevant concepts. Nonetheless that analogy seems meaningful. 
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What Should We Teach? 

If conventional theories of learning and memory have taught us 
one thing, it is that factual knowledge is difficult :o learni 
it becomes a lesson in paired-associate learning* Functional 
knowledge is different* Once the function is understood, the 
knowledge appears with relative ease, it is derived, not memorized* 
The functions are mnemonic devices, and so it is function that 
we should be teaching. 

There still remains the question of why: Why is functional 
knowledge easier to learn than factual knowledge? There is one 
reasonably obvious possible reason. A function has more constraints 
on its possible relations to other concepts than does a list 
of concepts. 
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barlier (Norman^ 1973), I made the argument that new material is 
learned most efficiently when integrated within the network of old 
knowledge by means of a web structure rather than a linear process. 
That is, the learning should add the new material by attaching a 
conceptual framework within memory to the old, previously acquired 
material. Then that framework should be elaborated upon, filling in 
the rough web with finer structures until a complete network has 
been acquired. By these successive stages of elaboration, 
new material is always firmly established within the framework 
created by the old. With more conventional teaching processes, 
learning occurs in a linear fashion, so that each new piece of 
information depends upon the knowledge of the succeeding new 
information. In this case, the structure is not sufficiently 
redundant, and If one link fails, then so must all that follows 
(see Figures 1 and 2). 

Insert Figures I and 2 about here 

In part, what functional learning might do is tie concepts with 
one another. Rote learning by temporal association is like linear 
learning; functional learning is web learning. ' 
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Figure 1. Linear Learning. New knowledge is added to the previous 
structure in a linear order. Lose one link, and all the 
rest is lost. Reprinted from Norman (1973) with permission 
of the publisher. 
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ORIGINAL STATE 




Figure 2. Iveb Learning. Pinst form a coarse net of concepts, each 

well connected to previous knowledge. Then build upon that 
to construct a firm, integrated web. This procedure is not 
so easy to perform as that of linear learning, but it should 
yield superior results. Reprinted from Norman (1973) with 
permission of the publisher. 
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The Near Miss 

One very important contribution to the study of learning is 
proviued by Winston (1973). What is an arch? A tower? 
A pedestal? Winston worried about how a system could come to learn 
these concepts simply by observing structures built from blocks while 
oeing told what they were. Suppose the task is to learn an "arch.^* 
Tne scheme he devised is that of noticing (nearly) all relations 
among the blocks, and using that set to define an arch, 
but suppose ,^the next example fulfilled the relations and yet was 
not an arch. This is the critical learning step, and for Winston, 
the nature of these examples was very important. The learning 
trials should consist of a carefully selected set of positive 
examples along with negative examples that were near misses. 
The learner forms the appropriate concept by comparing his acquired 
structure with that for the near miss, noticing the critical 
distinctions that cause the example to lie outside the 
definition. 

Winston derived a working example of how concepts might be 
learned (his system is a working computer program). His most 
important contribution, however, might be in his considp**at ion 
of the importance of the training-sequence, and in particular, 

the importance of the near miss. What Winston appears to have done is 
to provide teaching techniques that make clear just which attributes 
of the proDlem are the relevant ones. Thus, he combines an active 
learning process with subtle guides for the direction that the learner 
must follow. 
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Toward a New Learning Theory 

We must learn to characterize the strategies that are acquired 
by students. When a subject is engaged in a learning situation, he 
brings to bear not only his knowledge of the subject matter, but 
also his idea of the expectations of the situation. He has 
some overall concept of the situation he is in, he has a concept 
of the performance. expected of him, and he has some idee of the 
appropriate types of operations he can perform* Finally, he has to 
have some idea of the basic commands or operations available to solve 
the problems put before him. 

Clearly new knowledge must be well integrated within old if it 
is to be acquired easily and effectively. But this statement hides 
much. For one, the knowledge consists often of processes and 
routines, not static concepts. The memory theories developed in 
recent years say little or nothing of how anything other than 
concepts are acquired. For another, the fact that subjects maintain 
hierarchical levels of strategies and meta-stra tegi es means that 
the description of the integration of knowledge will have to account 
for the different levels of activity that is involved. 
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Two aspects of recent studies of memory seem especially relevant* 
First is the type of activities that bubjects perform during the 
accessibility form of rehearsal which help that material become available 
for ooth later recognition and recall. (A comparison with what subjects 
QO in the maintenance form of rehearsal would be productive.) Second is 
continuea study of the notion of "depth of processing most especially 
with the aim of determining why depth i s so often correlated with good 
retention. 

New knowledge seems easier to acquire when it is learned as 
a process than when it is learned as a 
collection of facts. All these features* of 
hypotheses, of process learning, of strategies, of 
incorporating new within old must be studied in order that we can 
learn about the process of learning. 
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Footnotes 



The research reported here was supported by the National Science 
Foundation Grant GB32235X and by the Advanced Research Projects 
Aqency and the Office of Naval Research of the Department of 
Defense and was monitored by ONR under Contract No. N00014-69-A- 
©200^6045. 

a 

The experimental studies are carried out by me and Donald 
Centner. The system programming has been performed by 
Mark Wall en. 

To the reader who believes this to be too simple a language 
to take seriously, I urge him to attempt these two problems. 

a. Print ^'yes" if the last two letters of the text are 
"ie-** or "ei^'; print "no" otherwise. 

The program should print "yes-" for dei, die, 
diie and diei, and "no" for died, dice and deii. 

b. Print the first word that has an "E-". If the text is 
"This is a sample sentence-", the program should print 
"sample-" • 

It is interesting to study now a subject is able to expand 
the statement of the problem into the set of conditions 
necessary to solve it. A reasonable amount of world 
knowledge is required. In my informal experiments, young 
children — around 7 to 8 years — tend to disallow the operation 
of emptying a container onto the ground. They tend to add 
another presupposition to the problems either that water 
cannot be wasted, or that ^'backup^' is not allowed. 



Clearly there are alternative ways of stating these 
operations* The rules could be more general^ with the 
three rules stated here subsumed under a single ^'pour" 
operation* They could also be more specific^ so that for 
the three jug problem there would be three -"fill-*' operations^ 
three "empty" operations^ and six ^'pours*'' Although the 
form does not matter^ the content does« the knowledge in 
Table 2 must be known in order to solve the problem. 



33 



References 

Bjork, R. A. AU-or-none subprocess in the learning of complex 
sequences. Journal of Mathematical Psycholoqy i 1968, b, 192-195. 



rijork, R. A. Rehearsal as a short-term holding operation in memory. 
In press. 

Bower, G. H. Analysis of a mnemonic device. Ameri can 5c ient ist , 
1970, 58, 496-510. 

Crailc, F. I. M. A "level of analysis" view of memory. In P. 
Plimer, L. Krames and T. M. Alloway (Eds.), Communication and 
AffectJ Language and Thought . New York* Academic Press, 1973. 

1 

Crailc, F. I. M. i Lockhart, R. S. Levels of processing: A framework 
for memory research. Journal of Verbal Learning and Verbal 
Behavior, 1972, 11, 671-684. 

Craik, F. I. M. & Watkins, M.J. The role of rehearsal in short-term 
memory. Journal of Verbal Learning and Verbal Behavior , in press. 

Eisenstadt, M. 4 Kareev, Y. Towards a model of human game playing^ 
Proceedings of the Third International Conference on Artificial 
Intelligence. Stanford, California, 1973. (Also available as 
La Jolla, California: Center for Human Information Processing, 
University of California, Technical Report 33*) 

ERLC 



54 



ureeiio, J. G. 'ihe structure of memory and the process of solving 

problems. In k . L. Sol so (hd.), Contemporary Issues in Cognitive 

Psychology: The Loyola Symposium. Washington, D.C.J Winston, 1973 
(Distributee by Halsted Press, John Wiley and Sons). 

Levine, iM. Hypothesis theory and nonlearning despite ideal 

S-H-reinf orcement contingencies. Psychological Review, 1971, 78, 

■ 

130-1 40. 

Luchins, A. S. Mechanization in problem solving. Psychologi cal 
Monographs, 1942, 134(6), Whole number 248. 



Newell, A. Simon, H. A. Human Problem Solving . Englewood Cliffs, 
New Jersey: Prentice-Hall, 1972. 

Norman, D. A. Memory, knowleage, and the answering of questions. 
In H. L. Solso (Ed.), Contemporary Issues in Co gnitive Psychology : 
The Loyola Symposium. Washington, D.C. « Winston, 1973 (Distributed 
by Halsted Press, John Wiley and Sons). 

Trabasso, f. & Bower, G. H. Attention in Learning. New York: Wiley, 
1968. 

Tulving, E. & Madigan, S. A. Memory and verbal learning. Annual 
Review of Psychology, 1970, 21, 437^484-. 

Wallace, W. H., Turner, S. H. <i . Perkins, C. C. Preliminary studies 
of human information storage. Philadelphia: Institute for Co- 
operative Research, The Moore School of Electrical Engineering 
ERJC Technical Report, The University of Pennsylvania, 1957. 



35 



y^dugh, N. C. A Norman, D. A. Primary memory. Psychological Revi ew , 
l9o5, 76, 89-104. 

Winston, P. Learning to identify toy block structures. In R. L. 

Solso (td.). Contemporary Issues in Cognitive Psychology: The Loyola 
Symposium . Washington, D .C . s Winston , 1973 (Distributed by 
Halstea Press, John Wiley and Sons). 

Woodward, A. H., Jr., Bjork, W. A. & Jongeward, R. H. , Jr. Recall 
and recognition as a function of primary rehearsal. Journal of 
Verbal Learning and Verba 1 Behavi or , in press. 



ERLC 



• 

Navy 



DTSTRIRUTION LIST 



U Dr. Marshall J. Farr, Director 

Personnel & Training Research Programs 
Office of Naval Research 
Arlington, VA 22217 

1 Director 

ONR Branch Office 
4.95 Suixer Street 
Boston, MA 02210 
ATTN: CM. Harsh 

1 Director 

ONR Branch Office 
1030 East Green Street 
Pasadena, CA 91101 
ATTN: E. E. Gloye 

1 Director 

ONR Branch Office 
536 South Clark Street 
Chicago, XL 6O6O5 
j ATTN: M. A. Bertin 

I 

1 Office of Naval Research 
Area Office 
.?07 V'est Street 
ilw York, NY 10011 

6 Director 

Naval Research Laboratory 
Code 2627 

V/ashington, DC 20390 

12 Defense Docunentation Center 
Cameron Station, Building 5 
5010 Duke Street 
Alexandria, VA 22314 

1 Chairman 
• Behavioral Science Department 

Naval Command and Management Division 

I U.S. Naval Academy 
Luce Hall 

Annapolis, MD 2U02 

I 1 Chief of Naval Technical Training 
Naval Air Station Menphis (75) 
Millington, TN 3^05^^ 

I ATTN: Dr. G. D. Mayo 



1 Chief of !Iaval Training 
Naval Air Station 
Pensacola, FL 32508 
ATTN: CAPT Bruce Stone, USN 

1 LCDR Charles J. Theiaen, Jr., MSC, USH 
U02U 

Naval Air Development Center 
Warminster, PA 18974^ 

3 Ccirjnander 

Naval Air Roaorvo 
Naval Air Station 
Glonviovf, IL 60026 

1 Commander 

Naval Air Systems Command 
Department of the Navy 
AIR-U3C 

Washington, DC 20360 

1 Mr. Lee Miller (AIR a3E) 
Naval Air Systems Cor^mand 
5600 Columbi a Pike 
Falls Church, VA 22042 

1 Dr. Harold Bcoher 
NAVAIR a5C 

Naval Air S2/stcn;s Command 
5600 Cola-nbia Pike 
Falls Church, VA 22042 

1 CAPT .John F. Riley, USN 
Commanding Officer 
U.S. Naval Amphibious School 
Coronado, CA 92155 

1 Special Assistant for Manpower 
OASN OBcRA) 

The Pentagon, Room 4E794 
Washington, DC 20350 

1 Dr. Richard J. Niehaus 

Office of Civilian Manpower Management 
Code 06A 

Department of the Navy 
Washington, DC 20390 



\ 



1 CDR Richard L. Martin, USN 
COMFAIRMIRAKAR 
NAS Miramar, CA 92U5 

1 Research Director, Code 06 

Research and Evaluation Department 
U,S. Naval Examining Center 
Great Lakes, IL 60088 
ATTN: C. S. Winievicz 

1 Chiof 

Bureau of Medicine and Surgery 
Code a3 

Washington, DC 20372 

1 Program Coordinator 

Bureau of Medicine and Surgery (Code 71G) 
Department of the Navy 
Waohington, DC 20372 

1 Commanding Officer 

Naval Medical Kexiropsychiatric 

Research Unit 
San Diego, CA 92152 

1 Dr. John J. Collins 

Chief of Naval Operations (OP-S 
Department of the ^h.'^ry 
Washington, DC 20350 

1 Techiiical Library (Pers-llB) 
Bureau of Naval Personnel 
Department of the Navy- 
Washington, DC 20360 

1 Dr. James J. Regain, Technical l^irec^or 
Navy Personnel Roseoroh 

and Development Csnter . 
San Idego, CA 92152 

1 Commanding Officer 
Navy Personnel Research 
and Development Center 
San Diego, CA 92152 

1 Superintende'it 

Naval Postgraduate School 
Monterey, CA 929A0 
Ami: Library (Code 21U) 



ERIC 



I 

1 Mr. George N. Graine 

Naval Ship Systems Command 
(SHIPS 03H) 

Department of the Navy 
Washington, DC 20360 

1 Technical Library 

Naval Ship Systems Command 
National Center, Building 3 
Room 3S08 

Washington, DC 20360 

1 Commanding Officer 
Service School Command 
U.S» Naval Training Center 
San Diego, CA 92133 
ATITJ: Code 303 

1 Chief of Naval Training Support 
Code N-21 
Building 

Naval Air Station 
Pensacola, FL 32508 

1 Dr. William L. Maloy 

Principal Civilian Advisor 

for Education and Training 
Naval Training Command, Code 01 A 
Irensacola, j<,^ou 

1 Mr. Arnold Rubinstein 

Naval Material Comnand (NMAT-0342^) 
Room 820, Crystal Plaza #6 
Washington, DC 20360 



1 Dr. H. Wallace Slnaiko 

o/o Office of Naval Research (Codo ^50) 
Psychological Sciences Division 
Arlington, VA 22217 

1 Dr. I-Iartin F. Wiskoff 
Navy Personnel Research 
and Development Center 
San Diego, CA 92152 

1 Dr. John Ford, Jr. 
Navy Personnel Research 
and Develoment Center 
San Diego, CA 92152 



Army 

1 Commandant 

U.S» Army Institute of Administration 
ATTN: EA 

Fort Benjamin Harrison, IN A6216 

1 Armed Forces Staff College 
• Norfolk, VA 23511 
ATTN: Library 

1 Director of Research 

U.S. Army Ai-mor Hioman Research Unit 

ATTN: Library 

Bxiilding 2422 Morade Street 

Fort Knox, KY A0121 

1 U.S. Army Research Institute for the 
Behavioral and Social Sciences 
1300 Wilson Boulevard 
Arlington, VA 22209 

1 Commanding Officer 
ATTN: LTC Montgomery 
USACDC - PASA 
Ft. Benjamin Harrison, IN 

1 Dr. John L. Kobrick 

Military Stress Laboratory 
U.S» Army Research Institute 

of Environmental Medicine 
Natick, MA 01760 

1 Commandant 

United States Army Infantry School 

ATTN: ATSIN-H 

Fort Benning, GA 31905 

1 U.S. Army Research Institute 
Commonwealth Building, Room 239 
1300 Wi] gon Boulevard 
Arlington, VA 22209 
ATTN: Dr. R. Dusek 

'1 Mr. Edmund F. Fuchs 

U.S. Army Research Institute 
1300 Wilson Boulevard 
Arlington, VA 22209 



1 Chief, Unit Training and Educational 

Technology Systems 
U.S. Army Research Institute for the 

Behavioral and Social Sciences 
1300 Wilson Boulevard 
Arlington, VA 22209 (3) 

1 Commander 

U.S. Theater Army Support Command, 
Europe ' 

ATTN: Asst. DCSPER (Education) 
APO New York 09058 

1 Dr. Stanley L. Cohen 
Work Unit Area Leader 
Organizational Development Work Unit 
Army Research Institute for Behavioral 

and Social Science 
1300 Wilson Boulevard 
Arlington, VA 22209 

1 Dr. Leon Nawrocki 

U.S. /irmy Research Institute 

Rossljni Commonwealth Building 

1300 Wilson Boulevard 

Arlington, VA 22209 (3) 
Air Force 

1 IJr. Martin Rockway 

Technical Training Division 

Lowry Air Force Base 

Denver, CO 80230 (3) 

1 MaJ. P. J. DeLeo 

Instructional Technology Branch 
AF Human Resources Laboratory 
Lowry AFB, CO 80230 (3) 

1 Headquarters, U.S. Air Force 

Chief, Personnel Research and Analysis 

Division (AF/DPSI) 
Washington, DC 20330 

1 Research and Analysis Division 
AF/DPXYR ■ Room iCC200 
Washington, DC 20330 



ERIC 



Coast Guard 



1 AFHRL/AS (Dr. G, A. Eckstrand 
Wright-Patterson AFB 
Ohio 45433 

1 AFHRL (AST/Dr. Ross L. Morgan) 
Wright Patterson Air Force Base 
Ohio 45433 

1 AFHRL/MD 

701 Prince Street 
Room 200 

Alexandria, VA 22314 

1 AFOSR<NL) 

1400 Wilson Boulevard 
Arlington, VA 22209 

1 Commandant 

USAF School of Aerospace Medicine 
Aeromedical Library (SUL-4) 
Brooks AFB, TX 78235 

1 CAPr Jack Thorpe, USAF 

Department of Psychology 

Bovrling Grocn State University 

Bowling Green, OH 43403 
1 Headquarters Electronic Systems Division 

ATTN: Dr. Sylvia R. MayerAciT 

LG Hanscom Field 

Bedford, MA 01730 

1 COL George Caridakis 

Director, Office of Manpower Utilization 

Headquarters, Marine Corps (AOIK) 

MCB 

Quantico, VA 22134 

1 Dr. A. L, Slafkosky 

Scientific Advisor (Code Ax) 
Commandant of the Marine Corps 
Washington, DC 20380 

1 Mr, E. A, Dover 

Majipower Measurement Unit (Code AOlM-2) 
Arlington Annex, Room 2413 
Arlington, VA 20370 



1 Mr. Joseph J/ Covan^, Chief 

Psychological Research Branch (P-l) 

. U.S. Coast Guard Headquarters 
400 Seventh Street, SW 
Washington, DC 20590 

Other DOD 

1 Lt, Col- Austin W. Kibler, Director 
Hiiman Resources Research Office 
Advanced Research Projects Agency 
1400 Wilson Boulevard 
Arlington, VA 22209 

1 Mr- Helga Yeich, Director 

Program Management, Defense Advanced 

Research Projects Agency 
1400 Wilson Boulevard 
Arlington, VA 22209 

1 Mr. William J. Stormer 
DOD Computer Institute 
Washington Navy Yard 
Building 175 
Washington, DC 20374 

1 Dr, Ralph R, Canter 

Director for Manpower Research 
Office of Secretary of Defense 
The Pentagon, Room 3C980 
Washington, DC 20301 



nr.hpr Government 

1 Office of Computer Information 
Institute for Computer Sciences 

and Technology 
National Bureau of Standards 
Washington, DC 20234 

1 Dr. Eric Mc Williams, Program Manager 
Teclmology and Systems, TIE 
National Science Foundation 
Washington, DC 20550 



ERLC 



Miscellaneous 



1 Dr. Scarvia Anderson 
• Executive Director for Special 
Developaent 
Educational Testing Service 
Princeton, NJ 0854-0 

1 Dr. Richard C. Atkinson 
Stanford University 
Department of Psychology- 
Stanford, CA 94305 

1 Dr. Bernard M. Bass 
University of Rochester 
Management Research Center 
Rochester, NY 14627 

1 Mr. Edmund C. Berkeley 
Berkeley Enterprises, Inc. 
815 Washington Street 
Nevtonville, MA 02160 

1 Dr. David G. Bowers 
University of Michigan 
Institute for Social Research 
P.O. Box 1248 
Ann Arbor, MI . 48106 

1 Mr. H. Dean Brown 

Stanford Research Institute 
333 Ravenswood Avenue 
Menlo Park, CA 94025 

1 Mr. Michael W. Brown 
Operations Research, Inc. 
1400 Spring Street 
Silver Spring, MD 20910* 

1 Dr. Ronald P. Carver 

American Institutes for Reseaifch 

8555 Sixteenth Street 
' Silver Spring, MD 20910 

1 Century Research Corporation 
4113 Lee Highway 
Arlington, VA 22207 

1 Dr. Kenneth E. Clark 
University of Rochester 
College of Arts- and Sciences 
River Campus Station 
Rochester, NY 14627 



1 Dr. Allan M. Collins 
Bolt Beranek and Newman 
50 Moulton Street 
Cambridge, MA 02138 

1 Dr. Rene' V. Dawis 
University of Minnesota 
Department of Psychology 
Minneapolis, 55455 

2 ERIC 

Processing and Reference Facility 
4833 Rugby Avenue 
Betl-iesda, MD 20014 

1 Dr. Victor Fields 

Department of Psychology 
Montgomery College 
Rockville, MD 20850 

1 Dr. Edwin A. Fleishman 

American Institutes for Research 
8555 Sixteenth Street 
Silver Spring, MD 20910 



1 Dr. Robert daser, Director 
University of Pittsburgh 
Learning Research and Development Center 
Pittsburgh, PA 15213 

1 Dr. Albert S. dLickman 

American Institutes for Research 
8555 Sixteenth Street 
'Silver Spring, MD 20910 

1 Dr. Duncan N. Hansen 
Florida State University 
Center for Computer-Assisted Instruction 
Tallahassee, FL 32306 

1 Dr. Henry J. Hamburger 
University of California 
School of Social Sciences 
Irvine, CA 92664 

1 Dr. Richard S. Hatch 

Decision Systems Associates, Inc. 
11428 Rockville Pike 
Rockville, MD 20852 



1 Dr, H. D. Hevron 

Human Sciences Research, Inc. 
Westgate Industrial Park 
7710 Old Springhcuse ?:oad 
McLean, VA 22101 



1 Human Resources Research Organization 
Division #3 
P.O. Box 5787 

Presidio of Monterey, CA 93940 

1 Human Resources Research Organization 
Division #4, Infantry 
P.O. Sox 2086 
Port Benning, OA 31905 

1 Human Resources Res h Organization 
Dr>7ision #5* Air De, e 
P.O. Box 6057 
Port Bliss, TX 79916 

1 Human Resources Research Organization 
Division #6, Library 
P.O. Box 428 

Port Rucker, AL 3636O ' 

1 Dr. Lawrence B. Johnson 

Lavrence Johnson and Associates, Inc. 
200 S Street, N.V., Suite 502 
I'Jashington, DG 20009 

1 Dr. Norman J. Johnson 
Carnegie-Mellon University 
School of Urban and Public Affairs 
Pittsburgh, PA 15213 

1 Dr . Da^-id Klahr 

Carnegie-Mellon University 
Graduate School of Industrial Admin. 
Pittsburgh, PA 15213 

1 Dr. Robert R. Macl-::le 

Human Factors Researchv, Inc. 
6780 Cortona Drive 
Santa Barbara Research Park 
Goleta, CA 93017 

1 Dr. Andrev'R. Molnar 

Technological Innovations in Education 
National Science Foundation 
Washington, DC 20550 

1 Dr. Leo Monday 
Vice President 

Amerj.can College Tas tins' Program 

P.O- Box 168 

Iowa City, lA 522^0 



1 Mr. Luigi Petrullo 

2431 North Edgewood Street 
Arlington, VA 22207 

1 Dr. Robert D. Pritchard 

Assistant Professor of Psychology 
Purdue University 
Lafayette, IN 47907 

1 Dr. Diane M^ Ramsey-Klee 
R-K Research & System Design 
3947 Ridgemont Drive 
Malibu, CA 90265 

1 Dr. Joseph V. Rigney 

Behavioral Technology Laboratories 
University of Southern California 
3717 South Grand 
Los Angeles, CA 90007 

1 Dr. Leonard L. Rosenbaum, Chairman 
Department of Psychology 
Montgomery College 
Rockville, MD 20850 

1 Dr. George E. Rowland 
Rowland and Company, Inc. 
P.O. Box 61 

Haddonfield, NJ 08033 

1 Dr. Milton S. Katz 
MIT^IE Corporation 
westgate Research Center 
McLean, VA 22101 

1 Dr. Charles A. Ullmann 
Director, Behavioral Sciences Studies 
Iriformation Concepts Incorporated 
1701 No. Ft. Myer Drive 
Arlington, VA 22209 



1 Mr. Dexter Pletcher 
Department of Psychology 
university of Illinois at Chicago Circle 
Sox l,3Lrt 

Chicago, IL 6O68O 



